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Abstract 

The problem of finding the zeros of the sum of two maximally monotone operators is of fundamental 
importance in optimization and variational analysis. In this paper, we systematically study Attouch- 
Thera duality for this problem. We provide new results related to Passty's parallel sum, to Eckstein and 
Svaiter's extended solution set, and to Combettes' fixed point description of the set of primal solutions. 
Furthermore, paramonotonicity is revealed to be a key property because it allows for the recovery of all 
primal solutions given just one arbitrary dual solution. As an application, we generalize the best approx- 
imation results by Bauschke, Combettes and Luke [J. Approx. Theory 141 (2006), 63-69] from normal 
cone operators to paramonotone operators. Our results are illustrated through numerous examples. 
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1 Introduction 
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and induced norm 



Let A: X ^Xbe a set- valued operator, i.e., (Vx G X) Ax C X. Recall that A is monotone if 



(2) 



(V(x,x*) € grA)(V(y,/) G grA) {x-y,x* -/) > 



and that A is maximally monotone if it is impossible to properly enlarge the graph of A while keeping 
monotonicity. Monotone operators continue to play an important role in modern optimization and variational 
analysis; see, e.g.. El, E], Ol, IHl, ||36l, Wl, (Ml, HI, il, ISl, ill, and ill. This is due to the fact 
that subdifferential operators of proper lower semicontinuous convex functions are maximally monotone, 
as are continuous linear operators with a monotone symmetric part. The sum of two maximally monotone 
operators is monotone, and often maximally monotone if an appropriate constraint qualification is imposed. 
Finding the zeros of two maximally monotone operators A and B, i.e., determining 



is a problem of great interest because it covers constrained convex optimization, convex feasibility, and many 
others. Attouch and Thera provided a comprehensive study of this (primal) problem in terms of duality. 
Specifically, they associated with the primal problem a dual problem. We set S^® = (—Id) oB^ o (—Id) 
where Id : X ^X: x i-)- x is the identity operator. The Attouch-Thera dual problem is then to determine 



This duality is very beautiful; e.g., the dual of the dual problem is the primal problem, and the primal 
problem possesses at least one solution if and only if the same is true for the dual problem. 

Our goal in this paper is to systematically study Attouch-Thera duality, to derive new results, and to 
expose new applications. 

Let us now summarize our main results. 

• We observe a curious convexity property of the intersection of two sets involving the graphs of A and 
B (see Theorem 13.31 ). This relates to Passty's work on the parallel sum as well as to Eckstein and 
Svaiter's work on the extended solution set. 

• We provide a new description of the fixed point set of the Douglas-Rachford splitting operator (see 
Theorem 14. 51 ); this refines Combettes' description of (A +B)^'0. 

• We reveal the importance of paramonotonicity: in this case, the fixed point set of the Douglas- 
Rachford splitting operator is a rectangle (see Corollary 15.61 ) and it is possible to recover all primal 
solutions from one dual solution (see Theorem [53]). 

• We generalize the best approximation results by Bauschke-Combettes-Luke from normal cone opera- 
tors to paramonotone operators with a common zero (see Corollary 16. 8 1 and Theorem 1 8. lb . 

The remainder of this paper is organized as follows. In Section |2j we review and slightly refine the basic 
results on Attouch-Thera duality. The solution mappings between primal and dual solutions are studied 



(3) 



(A + S)"^0= {xGX I OgAx + Sx}, 



(4) 
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in Section [3] Section |4] deals with the Douglas-Rachford sphtting operator. The results in Section [5] and 
Section [6] underline the importance of paramonotonicity in the understanding of the zeros of the sum. Ap- 
plications to best approximation as well as comments on other duality framework are the topic of the final 
Section m 

We conclude this introductory section with some notational comments. The set of zeros of A is written as 
zerA = A^'O. The resolvent and reflected resolvent is defined by 

(5) Ja = (Id +A)-^ and Ra = Ua - Id, 

respectively. It is well known that zerA = Fix/4 := {;c € X | Jax = x]. Moreover, J a is firmly nonexpansive 
if and only if Ra is nonexpansive; see, e.g., |[20l . ll28l . or OOl . We also have the inverse resolvent identity 

(6) 7a+/a-. =Id 
and the following very useful Minty parametrization. 

Fact 1.1 (Minty parametrization) Let A: X be maximally monotone. Then grA — > X : {a, a*) ^ a + 

a* is a continuous bijection with continuous inverse x 1— > {Jax,x — Jax); thus, 

(7) grA = { {Jax.x — Jax) | x e X} . 

Without explicit mentioning it, we employ standard notation from convex analysis (see |[36l . ll37l . or B2]| '). 
Most importantly, /* denotes the Fenchel conjugate of a function /, and df its subdifferential operator. The 
set of all convex lower semicontinuous proper functions on X is denoted by Y (or Tx if we need to emphasize 
the space). Finally, we set f := /o (-Id), which yields d{f) = (5/)®. 



2 Duality for monotone operators 

In this paper, we study the problem of finding zeros of the sum of maximally monotone operators. More 
specifically, we assume that 



(8) A and B are maximally monotone operators on X. 



Definition 2.1 (primal problem) The primal problem, for the ordered pair {A,B), is to find the zeros of 
A + B. 

At first, it looks strange to define the primal problem with respect to the (ordered) pair {A,B). The 
reason we must do this is to associate a unique dual problem. (The ambiguity arises because addition is 
commutative.) It will be quite convenient to set 



(9) A® = (-ld)oAo(-Id). 
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An easy calculation shows that (A ^)® = (A®) \ which motivates the notation 



(10) A-®:=(A-i)® = (A®)"\ 



(This is similar to the linear-algebraic notation A ^ for invertible square matrices.) 

Now since A and B form a pair of maximally monotone operators, so do A^^ and S^®: We thus define 
the dual pair 

(11) (A,B)*:=(A-SS-®). 
The biduality 

(12) (A,B)** = {A,B) 
holds, since [A-^Y^ =A, {B^Y =B, and (B®)-^ = (fi-^)®. 

We are now in a position to formulate the dual problem. 

Definition 2.2 ((Attouch-Thera) dual problem) The (Attouch-Thera) dual problem, for the ordered pair 
{A,B), is to find the zeros of A^^ +S^®. Put differently: the dual problem for (A,S) is precisely the primal 
problem for (A,S)*. 



In view of (fT2l) . it is the clear that the primal problem is precisely the dual of the dual problem, as 
expected. One central aim of this paper is to understand the interplay between the primal and dual solutions 
that we formally define next. 

Definition 2.3 (primal and dual solutions) The primal solutions are the solutions to the primal problem 
and analogously for the dual solutions. We shall abbreviate these sets by 



(13) Z:={A + B)-\0) and K:={A-^+B-®) (0), 



respectively. 

As observed by Attouch and Thera in [l] Corollary 3.2], one has: 
(14) Z/0 44> K^0. 

Let us make this simple but important equivalence a little more precise. In order to do so, we define 



(15) (VzeX) K-:={Az)n{-Bz) 
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and 



(16) {Vk£X) Zk:={A-^k)n{-B-®k) = {A-^k)n{B-\-k)). 



As the next proposition illustrates, these objects are intimately tied to primal and dual solutions defined 
in Definition 12. 3 1 

Proposition 2.4 Let z € X and let k gX. Then the following hold. 

(i) K. and are closed convex (possibly empty) subsets ofX. 

(ii) k£K,^ze Zu; 

(iii) z € Z 44> / 0. 

(iv) [j,ezK,=K. 

(v) Z^0 ^Kj^0. 

(vi) k£K^Zkj^0. 

(vii) UkeKZk = Z. 

Proof. |(i)} Because A and B are maximally monotone, the sets Az and Bz are closed and convex. Hence 
is also closed and convex. We see analogously that Z^ is closed and convex as well. 



(ii) This is easily verified from the definitions. 



(iii) Indeed, z G Z <^ G {A + B)z-^ {3a* eAzn{-Bz)) {3a* e K,) 



|(iv)[ Take k G Ujez-^z- Then there exists z G Z such that k e = Az fl (-Sz). Hence z G A^^k and 
ze{-B)-^k = B-^l-ld)-^k = B-\-k). Thus z G A^iyt and -zeB-'^k. Hence G (A"' and so 
k £ K. The reverse inclusion is proved analogously. 



(v) Combine (iii) and (iv)[ 



(vi)| & |(vii){ The proofs are analogous to the ones of |(iii)| & |(iv)l ■ 

Let us provide some examples illustrating these notions. 

Example 2.5 Suppose that X = M?, and that we consider the rotators by =F7r/2, i.e., 

(17) A:R^^R^:{xi,X2)^{x2,-xi) and B: : {x^xj) ^ {-X2,xi). 

Note that B = -A=A^^ =A*, where A* denote the adjoint operator. Hence A + S = 0, Z = X, and (Vz G Z) 
= {Az} = {-Bz}. Furthermore, A"' = B while the linearity of B implies that 5"® = B^ = -B = A. 
Therefore, (A,B)* = (B,A). Hence K = Z, while (VA: G ^) Z^t = {A-^k} = {Bk}. 
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Example 2.6 Suppose that X = ]R^, that A is the normal cone operator of M^, and that 5: X^X: {x^^xj)^ 
{—X2.,x\) is the rotator by 7i/2. As already observed in Example I2.5[ we have = —B and B^® = B^ = 
—B. A routine calculation yields 

(18) Z = M+x{0}; 
thus, since B is single-valued, 

(19) (Vz=(zi,0)eZ) K, = {-Bz] = {{0-Zy)]. 
Thus, 

(20) ^ = IJ ii:, = {0} X M_ 

zez 

and so 

(21) (V^=(0,^2) G^) Z^ = {-B-®^} = {M} = {(-^2,0)}. 

The dual problem is to find the zeros of A^^ i.e., the zeros of the sum of the normal cone operator 

of the negative orthant and the rotator by —n/l. 

Example 2.7 (convex feasibility) Suppose that A = Nu and B = Ny, where U and V are closed convex 
subsets of X such that U HV ^ 0. Then clearly Z = U HV . Using 17] Proposition 2.4. (i)], we deduce 
that (Vz G Z) = A^jj3y (0) = K. Note that we do know at least one dual solution: G K. Thus, by 
Proposition HHi Mvii)] (yk £K)Zt = Z. 



Remark 2.8 The preceding examples give some credence to the conjecture that 
(22) Z2 G Z V =^ either K^^ = K-^ or K^^ r\K,^ = 0. 




Note that (|22]) is trivially true whenever A or B is at most single-valued. While this conjecture fails in 
general (see Example |2.9| below). it does, however, hold true for the large class of paramonotone operators 
(see Theorem [ 



Example 2.9 Suppose that X = W^, and set ?7 := R x M+, V = M x {0}, and /?: X ^ X: {xi,X2) 
{—X2,x\). Now suppose that A = Nu +R and that B = Ny. Then domA = U and domB = V; hence, 
Aom{A + B) = U nV = V. Let ;c = (<§ ,0) G V. Then A;c = {0} x ]-oo, ,§] and B;c = {0} x M. Hence 
Ax C ±Bx, {A + B)x = {0} x M and therefore Z = V. Furthermore, = Axr\ {-Bx) = Ax. Now take 
3; = (t],0) G V = Z with \ <r]. Thtn = Ax Ay = Ky and thus ^ fails. 

Proposition 2.10 (common zeros) zer A n zerB / <^ G ^. 

Proof. Suppose first that z G zerA n zerB. Then G Az and G Bz, so G Az n (-Bz) =K-QK. Now 
assume that G K. Then G K^, for some z G Z and so G Az n (— Bz). Therefore, G zerA n zerB. ■ 
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Example 2.11 Suppose that B=A. Then Z = zer A, and zer A / <^ G /(T. 

Proof. Since 2A is maximally monotone and A+A is a monotone extension of 2A, we deduce that that 
A +A = 2A. Hence Z = zer(2A) = zerA and the result follows from Proposition 12. 101 ■ 

The following result, observed first by Passty, is very useful. For the sake of completeness, we include its 
short proof. 

Proposition 2.12 (Passty) Suppose that, for every {0,1} , Wi^Ayir\B{x—yi). Then (yQ—yi,WQ — w\) = 
0. 

Proof. (See ll33l Lemma 14] .) Since A is monotone, < {yo—y\,WQ — w\). On the other hand, since B is 
monotone, < {{x — yo) — {x — y\),WQ — w\) = {y\ —yQ,WQ — w\). Altogether, (yQ — y\,WQ — w\) = 0. ■ 

Corollary 2.13 Suppose that z\ and za belong to Z, that ki ^K,^, andthatk2 ^K,^. Then (k\ —k2,Zi —Zi) = 
0. 

Proof. Apply Proposition 12 . 1 2 1 (with B replaced by B® and at ;c = 0). ■ 

3 Solution mappings K and Z 

We now interpret the families of sets {K^)^^x and {Zk)kex as set- valued operators by setting 
(23) K:X^X:z^K. and Z: X ^X: Zk. 



Let us record some basic properties of these fundamental operators. 
Proposition 3.1 The following hold. 

(i) grK = grA ngr(-S) and grZ = grA"' n gr(-S"®). 

(ii) domK = Z, ranK = K, domZ = K, and ranZ = Z. 

(iii) grK and grZ are closed sets. 

(iv) Tlw operators K, — K,Z, — Z are monotone. 

(v) K-i =Z. 
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Proof. This is cleai^ from the definitions. 



|(ii)[ This follows from Proposition 



(iii) Since A and B are maximally monotone, the sets grA and grB are closed. Hence, by Ki)} grK is 



closed and similarly for grZ. 



(iv) Since grK C grA and A is monotone, we see that K is monotone. Similarly, since B is monotone 



and gr(— K) C grB, we obtain the monotonicity of — K. The proofs for itZ are analogous. 



(v) Clear from Proposition 12. ^tii) 



In Proposition I2.^fiii)| we observed the closedness and convexity of K, and Z^. In view of Proposi- 
tion [2!^iii)]&[(vii)J the sets of primal and dual solutions are both unions of closed convex sets. It would seem 



that we cannot a priori deduce convexity of these solution sets because unions of convex sets need not be 
convex. However, not only are Z and K indeed convex, but so are grZ and grK. This surprising result, 
which is basically contained in works by Passty |[33l and by Eckstein and Svaiter |[22l|23]| . is best stated by 
using the parallel sum, a notion systematically explored by Passty in |[33l . 

Definition 3.2 (parallel sum) The parallel sum of A and B is 

(24) AUB:={A-^ +B-^y\ 



The notation we use for the pai^allel sum (see ID Section 24.4]) is nonstandai^d but highly convenient: indeed, 
for sufficiently nice convex functions / and g, one has ^(/□g) = {df)\Z\{dg) (see |[33l Theorem 28], IIBTI 
Proposition 4.2.2], or lH Proposition 24.27]). 

The proof of the following result is contained in the proof of ll33l Theorem 21], although Passty stated a 
much weaker conclusion. For the sake of completeness, we present his proof. 

Theorem 3.3 For every x € X, the set 

(25) (grA) n ((x,0) -gr(-S)) = {{y,w) € grA \{x-y,w)(i grfi} 

is convex. 



Proof. (See also |[33l Proof of Theorem 21].) The identity (1251 ) is easily verified. To tackle convexity, for 
every / € {0, 1} take {yi,Wi) from the intersection ( |25] ); equivalently, 

(26) (V/G{0,1}) Wi(^Ayir\B{x-yi). 
By Proposition l2.12[ 

(27) {yQ-yi,wo-w\) =0. 

Now let t € [0,1], set {yt,Wt) = (1 -0(3'o,wo) +t{yi,w\), and take {a, a*) e grA. Using (|26l) and the 
monotonicity of A in (I28dl ). we obtain 

(28a) {yt-a,Wt-a*) = {{l-t){yQ-a)+t{yi-a),{\-t){wQ-a*)+t{wi-a*)) 
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(28b) = {\-tf {yo-a,W()-a*)+f {yi -a,wi-a*) 

(28c) +{\-t)t[{yQ-a,Wi-a*) + {yi - a, wq - a*) ) 

(28d) > (1 - 0^ ( (^'o - a, wi - a*) + {yy - a,WQ- a*)) . 



Thus, using again monotonicity of A and recalling (1271 ). we obtain 

(29a) {yQ-a,wi-a*) + (3^1 -a^WQ-a*) = (3^0 - a,>vi - wo) + iyQ-a,WQ-a*) 

(29b) +{yi-a,wo-W]) + {yi-a,W]_-a*) 

(29c) = {yi-yQ,WQ-wi) 

(29d) +{yQ-a,wo-a*) + {yi-a,wi-a*) 

(29e) >{yi-yo,WQ-W]) 

(29f) = 0. 

Combining (1281 ) and (l29l) . we obtain (y? — a, W; — a*) > 0. Since {a, a*) is an arbitrary element of grA and 
A is maximally monotone, we deduce that {yt,Wt) € grA. A similar argument yields {x — yt,Wt) € grB. 
Therefore, {yt,Wt) is an element of the intersection 



Before returning to the objects of interest, we record Passty's 1331 Theorem 21] as a simple corollary. 
Corollary 3.4 (Passty) For every x ^X, the set {A[l3B)x is convex. 

Proof. Letx G X. Since {y,w) — )■ w is linear and {(y,w) € grA | {x — y,w)^ gr^} is convex (Theorem [33]), 
we deduce that 

(30) {wGX I (3y eX)w £AynB{x-y)} is convex. 

On the other hand, a direct computation or |[33l Lemma 2] implies that {A\IlB)x = Uvex {'^y^^{^~y))- 
Altogether, {AnB)x is convex. ■ 

Corollary 3.5 For every x eX, the set (grA) n ((x, 0) + gr(— S)) is convex. 

Proof. On the one hand, — gr(— B®) = gr(— S). On the other hand, B® is maximally monotone. Altogether, 
Theorem |33] (applied with B® instead of B) implies that (grA) n {{x,0) -gr(-B®)) = (grA) n {{x,0) + 
gr(— B)) is convex. ■ 

Remark 3.6 Theorem 13.31 and Corollary 13.51 imply that the intersections (grA) n ±(gr — B) are convex. 
This somewhat resembles works by Martmez-Legaz (see ||29t Theorem 2.1]) and by Zalinescu B3l . who 
encountered convexity when studying the Minkowski sum/difference (grA) ± (gr — B). 

Corollary 3.7 (convexity) The sets gr Z and gr K are convex; consequently, Z and K are convex. 

Proof. Combining Proposition 13. ]|(i)| and Corollai'y I3.5l (with x = 0), we obtain the convexity of grK. Hence 



grZ is convex by Proposition 13. l|f v)| It thus follows that Z and K are convex as images of convex sets under 
linear transformations. ■ 
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Remark 3.8 Since Z = (A"'nS"')(0) and K = (Ans®)(0), the convexity of Z and K also follows from 
Corollary [331 

Remark 3.9 (connection to Eckstein and Svaiter's "extended solution set") In IIH Section 2.1], Eck- 
stein and Svaiter defined in 2008 the extended solution set (for the primal problem) by 

(31) Se{A,B):={{z,w)eXxX | w € Sz, -w G Az). 

It is clear that grZ^^ = grK = 5^.(5, A) = —Se{A,B). Unaware of Passty's work, they proved in ll22l 
Lemma 1 and Lemma 2] (in the present notation) that Z = ranZ, and that grZ is closed and convex. Their 
proof is very elegant and completely different from the above Passty-like proof. In their 2009 follow-up pa- 
per |[23l . Eckstein and Svaiter generalize the notion of the extended solution set to three or more operators; 
their corresponding proof of convexity in |[23l Proposition 2.2] is more direct and along Passty's lines. 

Remark 3.10 (convexity of Z and K) If Z is nonempty and a constraint qualification holds, then A + S is 
maximally monotone (see, e.g., ||5l Section 24.1]) and therefore Z = zer(A + B) is convex. It is somewhat 
surprising that Z is always convex even without the maximal monotonicity ofA+B. 



One may inquire whether or not Z is also closed, which is another standard property of zeros of maximally 
monotone operators. The next example illustrates that Z may fail to be closed. 

Example 3.11 (Z need not be closed!) Suppose that X = £2, the real Hilbert space of square-summable 
sequences. In [jlOi Example 3.17], the authors provide a monotone discontinuous linear at most single- 
valued operator S on X such that S is maximally monotone and its adjoint 5* is a maximally monotone 
single-valued extension of —S. Hence dom5 is not closed. Now assume that A = S and B = S*. Then A + S 
is operator that is zero on the dense proper subspace Z = dom(A +B) = domS of X. Thus Z fails to be 
closed. Furthermore, in the language of Passty's parallel sums (see Remark [3^ . this also illustrates that the 
parallel sum need not map a point to a closed set. 

Remark 3.12 We do not know whether or not such counterexamples can reside in finite-dimensional Hilbert 



spaces when domA ndomB 7^ 0. On the one hand, in view of the forthcoming Corollary 15. 5|(i)[ any coun- 
terexample must feature at least one operator that is not paramonotone, which means that the operators 
cannot be simultaneously subdifferential operators of functions in P. On the other hand, one has to avoid 
the situation when A + B is maximally monotone, which happens when ridomA RridomB ^ 0. This means 
that neither is one of the operators allowed to have full domain, nor can they simultaneously have relatively 
open domains, which excludes the situation when both operators are maximally monotone linear- relations 
(i.e., maximally monotone operators with graphs that are linear subspaces, see |[9l). 

Remark 3.13 We note that K and Z are in general not maximally monotone. Indeed if Z, say, is maximally 
monotone, then Corollary 13.71 and S Theorem 4.2] imply that grZ is actually affine (i.e., a translate of a 
subspace) and so ai^e Z and K (as range and domain of Z). However, the set Z of Example I2.7l need not be 
an affine subspace (e.g., when U , V and Z coincide with the closed unit ball in X). 



10 



4 Reflected Resolvents and Splitting Operators 



We start with some useful identities involving resolvents and reflected resolvents (recall (HJ). 
Proposition 4.1 Let C: X be maximally monotone. Then the following hold. 

(i) R^_, = -Rc. 

(ii) Jc& = J^. 

(iii) /?^_® =Id-27®. 



Proof, [g)) By Q, we have = 27^-1 - Id = 2(Id -Jc) - Id = Id -27c = -(27c - W) = -Rc- 



(ii)| Indeed, 

(32a) 7cffl = (ld+(-Id)oCo(-Id))"^ 
(32b) = ((-Id)o(Id+C)o(-Id))"^ 

(32c) = (-Id)-'o(Id+C)"^o(-Id)-i 

(32d) = (-Id)o7co(-Id) 

(32e) =7®. 



(in)] Using © and[(ii)j we have that /?c-© = 27c-® - Id = 2(Id -7c® ) - Id = Id -27^. 



Corollary 4.2 (Peaceman-Rachford operator is self-dual) (See Eckstein's |[T9l Lemma 3.5 on page 125].) 
The Peaceman-Rachford operators for (A,B) and {A,B)* = coincide, i.e., we have self-duality 

in the sense that 

(33) RbRa = Rr-^Ra-^ ■ 
Consequently, 

(34) (VAg[0,1]) (l-A)Id+A/?B/?A = (l-A)Id+A/?B-®/?^-i. 



Proof Using Proposition HJiMiii)] we obtain ^ Rb &Ra-i = (Id-27^)(-/?A) = -Ra + 2JbRa 



{2Jb - Id)/?A = RbRa- Now ^ follows immediately from (l33l) . 

Corollary 4.3 (Douglas-Rachford operator is self-dual) (See Eckstein's Lemma 3.6 on page 133].) 
For the Douglas-Rachford operator 

(35) ^(A,fi) •= ^Id + ^^B^A 

we have 

(36) ^(A,B) = -^B^A + Id —7a = Tj-A-l B-ffl) . 
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Proof. The left equality is a simple expansion while self-duality is (l34l ) with A = ■ 

Remark 4.4 (backward-backward operator is not self-dual) In contrast to Corollary 14.21 the backward- 
backward operator is not self-dual: indeed, using Q and Proposition 14. l|f iii)l we deduce that 

(37) Jb-uJa-^ = (Id -7®) (Id -7a) = Id-Z^ +7b(7a -W) = (7^ - Id) (/4 - Id) . 

Thus if A = and domS is not a singleton (equivalently, Ja = Id and ran/g is not a singleton), then 
Jb-qiJa-i = {Jb — ld)0 = JbO ^Jb = JbJa- 

For the rest of this paper, we set 



(38) T = Ud+\RBRA=JBRA + \d-JA. 



Clearly, 

(39) VixT = VixRbRa. 
Theorem 4.5 The mapping 

(40) gvK^VixT: {z,k)^z + k 

is a well defined bijection that is continuous in both directions, with : x ^ {Jax,x — Jax). 

Proof. Take (z, k) € grK. Then k£K, = (Az) n {-Bz). Now k e Az z + k e {Id +A)z ^z = Ja{z + k), 
and k € {-Bz) ^-keBz<^z-ke (Id+B)z 4^ z = JB{z-k). S&t x:=z + k. Then JAX = JA{z + k) =z 
and hence Rax = 2Jax — x = 2z—{z + k) = z — k. Thus, 

(41) Tx = x- Jax + JbRax = z + k — z + Jb{z- k) = k + z = x, 

i.e., X G FixT. It follows that ^ is well defined. 

Let us now show that *F is surjective. To this end, take x G Fix T. Set z '■= Jax as well as k := (Id —Ja)x = 
x — z. Clearly, 

(42) x = z + k. 
Now z = /ax <4> X G (Id +A)z = z + Az 4^k = x-zeAz. Thus, 

(43) G Az. 

We also have /?a-^ = 27a-^ — x = 2z — (z + ^) = z — k; hence, x = Tx = x — Jax + JbRax -^^ Jax = JbRax ^ 
z = JB{z-k)<^z-ke {ld+B)z = z + Bz-^ 

(44) k G -Bz. 
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Altogether, k € (Az) n {—Bz) = K^<=> {z,k) G grK. Hence *F is surjective. 

In view of Fact ll.ll and since grK C grA, it is clear that *F is injective with the announced inverse. ■ 

The following result is a straight-forward consequence of Theorem 14.5 1 
Corollary 4,6 We have 

(45) (Vzez) = 74-1(74- ^zn Fix r) 

and 

(46) {yk eK) Zk = J A (7^i, k n Fix T) . 
Corollary 4.7 (Combettes) (see IHl Lemma 2.6(iii)]) 7a (Fix T) = Z. 

Proof. Set 2 : X X X ^ X : (a;i ^xj) ^xi.By Theorem |43] and Proposition |3J|Iii)j 7A(Fixr) = gran*^"' = 
2dom»F = 2(grK) = domK = Z. ■ 

Example 4.8 (see also |i6l Fact Al]) Suppose that A =Nu and B = Ny, where U and V are closed convex 
subsets of X such that [/ n V / 0. Then Pu (Fix T) = UnV. 

Corollary 4.9 (Id -7a ) (Fix T)=K. 

Proof. Either argue similarly to the proof of Corollary 14.71 or apply Corollary l4.7l to the dual and recall that 
T is self-dual by Corollary 14.31 ■ 



5 Paramonotonicity 

Definition 5.1 A monotone operator C: X is paramonotone, if 

X* eCx ^ 

(47) y*^Cy \ =^ X* e Cy and y* £ Cx. 

{x-yX-y*)=o} 

Remark 5.2 Paramonotonicity has proven to be a very useful property for finding solution of variational 
inequalities by iteration; see, e.g., |[27l . ifTTl . lITSl . ll32l . and ll24]| . Examples of paramonotone operators 
abound: indeed, each of the following is paramonotone. 

(i) df, where / G T |l27'. Proposition 2.2]. 

(ii) C : X ^X, where C is strictly monotone. 

(iii) W -^W: x^Cx + b, where C G R"""", b eW\C+ = + \c'^ , kerC+ C kerC, and C+ is positive 
semidefinite ll27l Proposition 3.1]. 
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For further examples, see ll27l . When C is a continuous Uneai" monotone operator, then C is paramonotone 
if and only if C is rectangular (a.k.a. 3* monotone); see 131 Section 4]. It is straight-forward to check that 
for C: X ^X, we have 

C is paramonotone <^C^^ is paramonotone 
(48) C® is paramonotone 

44> C^® is paramonotone. 

Theorem 5.3 Suppose that A and B are paramonotone. Then {\/z GZ) K, = K and {\/k G K) Zk= Z. 



Proof. Suppose that zi and Z2 belong to Z and that zi / Z2- Take ki e K^^ =Azi n (— Bzi) and kz € K^^ = 
Az.2 n {-Bzi). By Corollary ITU 

(49) {ki-k2,zi-Z2)=0. 

Since A and B are paramonotone, we have kz € Azi and — G ^Zi; equivalently, G ^zi- It follows that 
^ ^zi- Since the reverse inclusion follows in the same fashion, we see that K-^ = K^^. In view of 



Proposition ll.'^f iv) K-^ = K, which proves the first conclusion. Since A and B are paramonotone so are A ^ 
and B^® by (1481 ). Therefore, the second conclusion follows from what we already proved (applied to A^^ 
and fi-®). ■ 



Remark 5.4 (recovering all primal solutions from one dual solution) Suppose that A and B are para- 
monotone and we know one (arbitrary) dual solution, say ko G K. Then 

(50) z^„=A-'^on(s-'(-^o)) 

recovers the set Z of all primal solutions, by Theorem [53] If A = df and B = dg, where / and g belong to 
F, then, since (df)^^ = df* and {dg)^^ = dg*, we obtain a formula well known in Fenchel duality, namely, 

(51) Z = df*{ko)r\dg*{-ko). 

We shall revisit this setting in more detail in Section |7] In striking contrast, the complete recovery of aU 
primal solutions from one dual solution is generally impossible when at least one of the operators is no 
longer paramonotone — see, e.g.. Example |2. 61 where one of the operators is even a normal cone operator. 

Corollary 5.5 Suppose A and B are paramonotone. Then the following hold. 

(i) Z and K are closed. 

(ii) grK and grZ are the "rectangles" ZxK and K xZ, respectively. 

(iii) FixT = Z + K. 

(iv) {Z-Z)±{K-K). 

(v) span {K — K) = X ^ Z is a singleton. 
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(vi) span {Z — Z)=X^Kisa singleton. 



Proof. Combine Theorem [53] and Proposition 12.41 
(ii)[ Clear from Theorem [53] 



(iii) Combine (ii) with Theorem 



(iv)| Combine Corollary 12. 131 with Theorem 15. 31 



(v)] In view of [(iv)] wehavethatO= (Z-Z,^-ii:) = (Z -Z, span = {Z-Z,X) ^Z-Z = {0} 



44> Z is a singleton. 

(vi) This is verified analogously to the proof of |(v)| 



Corollary 5.6 Suppose that A and B are paramonotone. Then Fix T = Z + K, Z = Ja{Z + K) and K 
JA-i{Z + K) = {ld-JA){Z + K). 



Proof. Combine Corollary 15. yii)| with Theorem 14. 51 



Remark 5.7 (paramonotonicity is critical) Various results in this section — e.g., Theorem 15. 3[ Re- 
mark [531 Corollary I5.5|(ii)| - [(vi)] — fail if the assumption of paramonotonicity is omitted. To generate these 
counterexamples, assume that A and B are as in Example 12. 5 1 or Example[ 



6 Projection operators and solution sets 

The following two facts regarding projection operators will be used in the sequel. 

Fact 6.1 (See, e.g., IH Proposition 2.6].) Let U and V be nonempty closed convex subsets ofX such that 
U ^-V. Then U + V is convex and closed, and Pv+v = Pu + Pv- 

Fact 6.2 Let S be a nonempty subset ofX, and let j € X. Then {\/x € X) Py-^si^) = y + Ps{^ ~ y)- 

Theorem 6.3 Suppose that A and B are paramonotone, that (zo,^o) ^ Z x K, and that x X. Then the 
following hold. 

(i) Z + K is convex and closed. 

(ii) Pz+k{x) =Pz{x- ko) + Pk{x - Zo). 

(iii) // (Z - Z) ± K, then Pz+k{x) = Pz{x) + Pk{x - zo). 

(iv) IfZ ±{K- K), then Pz+k{x) = Pz{x - + Pk{x). 
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Proof, [(i)] The convexity and closedness of Z and K follows from Corollary 13.71 and Corollary I5.5|ri)| By 
Corollary IS.^fiv) 

(52) {Z-zo) ^{K-h). 
Using Fact 16. 1[ 

(53) Z + — zo — ^0 is convex and closed, and Pz+K-zo-ko 

Hence Z + ZT is convex and closed. |(ii)[ Using (1531 ). Fact 16. 11 and Fact l6.2[ we obtain 

(54a) 
(54b) 
(54c) 
(54d) 



Pz-zo+PK-ko- 



Pz+KX = P{za+k))+(Z+K-zo-k))X 

= ZO + ^0 + P(Z-zo)+{K-k,) {x -{Zo + ko)) 

= Zq + Pz-zo ( {x - ko) - zo) +kQ + PK-ko {(x-zo)- ko) 



= Pz{x-ko)+PK{x-Zo). 

(iii)[ Using Fact 16. H and Fact 16. 2[ we have 



(55a) 
(55b) 
(55c) 
(55d) 



Pz+KX - Pzo+{Z+K-zo} 



■■Zo + P(z-z,o)+k{x-Zo) 

■ Zq + Pz-zo {x-ZQ)+PKix-Zo) 

-Pzx + Pk{x-zo). 



(iv) Argue analogously to the proof of (iii) 



Remark 6.4 Suppose that A and B are paramonotone and that ^ K. Then Corollarv 15. 5|(iv)| implies that 
{Z — Z) ± ^ — {0} = K and we thus may employ either item (ii) (with = 0) or item |(iii)| to obtain the 
formula for Pz+k- 



However, if {Z — Z)l. K, then the next two examples show — in strikingly different ways since Z is either 
large or small — that we cannot conclude that ^ K: 

Example 6.5 Fix u and suppose that (V;c £X) Ax = u and B = —A. Then A and B are paramonotone, 
A + B = 0, and hence Z = X. Furthermore, K = {u}. Thus if m / 0, then K ^X = (Z-Z). 

Example 6.6 Let U and V be closed convex subsets of X such that 

(56) O^UnV andU -V = X. 

(For example, suppose that X = R and setU = V = [l,+oo[.) Now assume that {A,B) = {Nu,Nv)*. In 
view of Example |2.7[ K = U CiV and Z = Njj^zyiO) = Nx{0) = {0}. Hence Z is a singleton and thus 
Z-Z = {0} ±K while 0(^K. 

Theorem 6.7 Suppose that A and B are paramonotone, let ko € K, and let x € X. Then the following hold. 
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(i) JAPz+K{x)=Pz{x-kQ). 

(ii) // (Z - Z) ± K, then J a o Pz+k = Pz- 



Proof. Take an arbitrary zo G Z. [(i)] Sttz'-= Pz{x — h))- Using Theorem (6 . 3|f ii) | and Theorem 1531 we have 



(57) Pz+KX - z = Pz+KX - Pz{x - ko) = Pk{x -Zo)&K = K,Q Az. 

Hence Pz+kx G (Id +A)z<^z = JaPz+kx ■^Pz{x-ko)= JaPz+kx. 

(ii)[ This time, let us set z : = Pzx. Using Theorem 16. 3|(iii)| and Theorem [531 we have 



(58) Pz+KX - z = Pz+KX - Pzx = Pk{x -Zo)eK = K,C Az. 

Hence Pz+kx G (Id +A)z-^z = JaPz+kx ^ Pzx = JaPz+kx. ■ 
Corollary 6.8 Suppose that A and B are paramonotone, and that & K. Then 

(59) Pz = JaPz+k. 

Specializing the previous result to normal cone operators, we recover the consistent case of ||7l Corol- 
lary 3.9]. 

Example 6.9 Suppose that A = Ny and B = Ny, where U and V are closed convex subsets of X such that 
UnVj^0. Then Z = UnV,K = Njj^{0), and 

(60) Pz = PijPz^j^ = PfjP^-^j. 

Proof. This follows from Example |2.7[ Corollarvl5.5|(iii)[ and CoroUarv 16.81 ■ 



7 Subdifferential operators 

In this section, we assume that 

(61) A = df and B = dg, 
where / and g belong to P. We consider the primal problem 

(62) minimize 

xex 

the associated Fenchel dual problem 

(63) minimize /* {x* )+g*{ —x* ) , 

x*ex 
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the primal and dual optimal values 

(64) M = inf(/ + g)(X) and pi* = Mif + g*'){X). 
Note that 

(65) pi > -p*. 

Following | fT2| and |[T3l . we say that total duality holds if jU = — /i* € M, the primal problem (l62l ) has a 
solution, and the dual problem (1631 ) has a solution. 



Theorem 7.1 (total duality) Suppose that A = df and B = dg, where f and g belong to F. Then Z 7^ 
total duality holds, in which case Z coincides with the set of solutions to the primal problem (I62I ). 

Proof. Observe that (df)-^ = df* and that (^g)"® = {dg*)® = 

"=>": Suppose that Z ^ 0, and let z ^ Z. Then € df{z) + dg{z) ^ 5(/ + g)(z). Hence z solves the 
primal problem ([62]), and 

(66) p=f{z)+g{z). 

Take k e K = K, = {df){z) n First, we note that G (dfy^k) + {dg)-®{k) = df*{k) + 

dg*''{k) C + and so k solves the Fenchel dual problem Thus, 

(67) p* =f*{k)+g*'^{k). 

Moreover, k G 5/(z) and -k G i.e., f{z) +f*{k) = (z,^) and g{z)+g*{-k) = {z, -k). Adding these 

equations gives = f{z)+f*{k) + g{z) + g*^ {k) = p + p*. This verifies total duality. 

"<^": Suppose we have total duality. Then there exists x G dom/ndomg and x* G dom/* ndom^*"^ such 
that 

(68) f{x) +g{x) = p = -p* = -f*(x*)-g*\x*) G M. 

Hence = {f {x) + f* {x*)) + {g{x) + g* {-x*)) > {x,x*) + {x,-x*) = 0. Therefore, using convex analysis 
and Proposition [ 



(69) {x* G df{x) and - x* G ^ x* G /Tv ^ ^ G Z;,* . 
Hence x G Z. 

Note that Z = zei:{df + dg) C zer5(/ + g) since gT{df + dg) C gr5(/ + g). Hence Z is a subset of the 
set of primal solutions. Conversely, if x is a primal solution and x* is a dual solution, then (1681 ) holds and the 
rest of the proof of "<^=" shows that x G Z. Altogether, Z coincides with the set of primal solutions. ■ 

Remark 7.2 (sufficient conditions) On the one hand, 

(70) the primal problem has at least one solution 
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if dom/ndomg / and one of the following holds (see, e.g., ID Corollary 11.15]): (i) / is supercoercive; 
(ii) / is coercive and g is bounded below; (iii) G sri(dom/* + domg*) (by, e.g., IS Proposition 15.13] and 
since (l62l ) is the Fenchel dual problem of (l63l)). On the other hand, 

(7 1 ) the sum rule d{f + g) = df + dg holds 

whenever one of the following is satisfied (see lH Corollary 16.38]): (i) G sri(dom/ — domg); (ii) dom/fl 
intdomg ^ 0; (iii) dom^ = X; (iv) X is finite-dimensional and ridom/nridomg ^ 0. If both (TTOI ) and 
dTTI ) hold, then Z ^ and Z coincides with the set of primal solutions. 



8 Algorithms and Eckstein-Ferris-Robinson Duality 

In this last section, we sketch first algorithmic consequences and then conclude by commenting on the 
applicability of our work to a more general duality framework. 

Theorem 8.1 (abstract algorithm) Suppose that A and B are paramonotone. Let {xn)nen be a sequence 
such that {x„)nen converges (weakly or strongly) to x ^ FixT and {JAXn)nen converges (weakly or in norm) 
to Jax. Then the following hold. 

(i) (ykeK) JAX = Pzix-k). 

(ii) // (Z - Z) _L K, then Jax = Pzx. 



Proof. Combine Corollary I5.yiii)| with Theorem 16.71 



We provide three examples. 

Example 8.2 (Douglas-Rachford algorithm) Suppose that A and B are paramonotone and that the se- 
quence (;c„)„eN is generated by (Vn G N) x„+i = Txn. The hypothesis in Theorem 18.11 is satisfied, and 
the convergence of the sequences is with respect to the weak topology ||40l . See also ||2]| for a much simpler 
proof and lH Theorem 25.6] for a powerful generalization. 

Example 8.3 (Halpern-type algorithm) Suppose that A and B are paramonotone and that the sequence 

{xn)neN is generated by (Vn G N) x„+i = (1 — Xn)Txn + where (A„)„eM is a sequence of parameters 
in ]0, 1[ and j G X is given. Under suitable assumptions on it is known (see, e.g., ll25l . PTI ) 

that Xn ^ X := PpaTj with respect to the norm topology. Since J a is (firmly) nonexpansive, it is clear 
that the hypothesis of Theorem 18. II holds. Furthermore, JaXh — )■ Ja^ = /A^FixrJ- Thus, if k^ G K, then 



JaXu Pziy — ko) by Theorem l6.'^(i)[ And if (Z — Z) _L K, then — )• Pzy by Theorem l6.'^(ii) 



Example 8.4 (Haugazeau-type algorithm) This is similar to Example 18.31 in that x„ — > x := P^ixTy with 
respect to the norm topology and where y G X is given. For the precise description of the (somewhat 
complicated) update formula for {xn)nen, we refer the reader to Section 29.2] or O; see also ll26l . Once 



again, we have JaXu Ja^ = -/A^ixTj and thus, if G ^> then /^-^n Pziy — k^^ by Theorem l6.'^(i)[ And if 
(Z — Z) _L K, then JaXji — )■ Pzy by Theorem I6.'^fii)[ Consequently, in the context of Example I6.9[ we obtain 
Pj/x„ PucNy\ in fact, this is HI Theorem 3.3], which is the main result of HI. 
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Turning to Eckstein-Ferris-Robinson duality, let us assume the following: 



• F is a real Hilbert space (and possibly different from X); 

• C is a maximally monotone operator on Y ; 

• L : X — )• y is continuous and linear. 



Eckstein and Ferris II2TI as well as Robinson 11351 consider the problem of finding zeros of 
(72) A + L*CL. 

This framework is more flexible than the Attouch-Thera framework, which corresponds to the case when 
Y = X and L = Id. Note that just as Attouch-Thera duality relates to classical Fenchel duality in the subdif- 
ferential case (see SectionlT]), the Eckstein-Fenis-Robinson duality pertains to classical Fenchel-Rockafellar 
duality for the problem of minimizing f + hoL when / G Fx and /i € Fy , and A = df and C = dh. 

The results in the previous sections can be used in the Eckstein-Fenis-Robinson framework thanks to 



items (ii) and (iii) of the following result, which allows us to set B = L*CL. 



Proposition 8.5 The following hold. 

(i) IfC is paramonotone, then L*CL is paramonotone. 

(ii) (Pennanen) 7/'M_|__|_(ranL — domC) is a closed subspace ofY, then L*CL is maximally monotone. 

(iii) IfC is paramonotone and ]R++(ranL — domC) is a closed subspace ofY, then L*CL is maximally 
monotone and paramonotone. 

Proof, [(i)] Take x\ and X2 in X, and suppose that x\ € L*CLxi and x\ G L*CLx2. Then there exist y\ G 
CLxi and y^ G CLxj such that x^ = L*y\ and x^ = L*yl. Thus, {xi —X2,x\ —x*rf) = {xi —X2,L*y\ —L*yl) = 
{Lxi —Lx2,y\ — 3^2) ^ because C is monotone. Hence L*CL is monotone. Now suppose furthermore that 
{x\ —X2,x\ —X2) = 0. Then {Lx^ —Lx2,y\ — 3^2) ~ ^ ^'^'^ paramonotonicity of C yields G C{Lx\) and 
y\ G C{Lx2)- Therefore, 4 = L*yl G L*CLxi and x\ = L*y\ G L*CLx2- 



(ii)t See IMl Corollary 4.4.(c)]. 



(iii) Combine [(1)] and [(ii) 
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